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three tasks were (Da problem sdving task (PSX (2) a chemistry task requiring a 
certain combination of substances to obtain a correct answer(CH). and (3J a 
correlation task requiring the matching of certain elements to obtain the correct 
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A Preliminary Sear<^h for Formal Operations Structures 

Edith 0* Keimark 

Douglass College, Rutgers.The State University 



Abstract 



In an attempt to evaluate intercorrelations among tasks presumed 
to measure development of formal operations thought, sixty«one fourth, 
fifth, and sixth graders were given three tasks in two sessions » The 
tasks were a diagnostic problem-solving task, PS, and two of Ihhelder 
and Piaget*s tasks: combinations of colored and colorless chemical 

bodies, CH, and correlations, CO, A low but consistent and significant 



Result:' were interpreted as consistent with the view that formal oper- 
ations tasks -- at least those employed in the present study are 
correlated. The appropriateness of die CH task was questioned. 
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correlation was obtained between PS and C0$ CH correlated with neither 
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A Preliminary Search for Formal Operations Structurea 

Edith D, Keimark 

Douglaas College, Rutgera— -the State Onlverslty 
Piaget views cognitive development as a hierarchical px*oceaa 
concerned with the consolidstion of structures at progresaively higher 
levels of abstraction* Although hla theoretical position is widely 
known and has become the focus for an increasing volume of research in 
recent years there is almost no direct evidence for the existence of 
**8txvcturea**. Specifically, although, e.g., Ihhelder and Piaget v S5S) 
report the results of a number of studies of tasks asserted to be diag- 
nostic of formal operations thinking —which may or may not have been 
run on the same Sa— there is no evidence of tte intercorrelations among 
these traaks which would support the assumption that they do, in fact, 
reflect a coherent structure. Recently Shants (1967) and Goldschmld (1967) 
have reported data which support tiie assumption of intercorrelation among 
tasks reflecting logical multiplication and conservation, reapectively. 
There are, as yet, no available data concerning the more abstract, 
formal operations level of thinking, the present experiment represent«t 
an attempt to fill that gap by providing evidence on tlm intercorrelation 
among two Piaget formal operations tasks (correlation and the chemistry 
experiment) and a problem solving task (Neinerk and Lewis, 1967) which 
aeems to get at formal operations thinking. 

Method 

Subje cts, thirty-five sixth graders in the Ethel Roads achool in 
Piscataway, N.J. and 26 fourth, fifth, and sixth graders (^3, 16, 7 
respectively) in the Roosevelt school in South Plainfield, H.J. served 
as there were 31 boys and 30 girls whoae Otis IQ score ranged from 
92-138. Additional information on group composition ia summarized in 
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Table 1. For all but one S in Ethel Roads data on the Stanford Achieve* 
ment test (administered in Mey> 1967) were also available. 



Apparatu s. Three tasks were used: a problem solving task which has been 

described in detail elsewhere G?eimerk and Lewis, 1967) , a variant of 
the coKibinatorial problem used by Inhaler and Piaget (1958) and VTynns 
(1967), and a variant of Inhelder and Piaget (1958) concept of correlation 
task. The tasks will hereafter be referred to as the problem-solving, PS, 
chemistry, CH, and Correlation, CO, tasks respectively. Materials for 
the PS task consisted of a 9 sQ. in. wooden board with 8 movable shutters. 



which had been pre-loaded with 8 problems, and 8 acconqsanying answer- 



Inhelder and Piaget with the exception that phos{dioric acid was substituted j 

for sul{diuric acid. Each of the substances was presented in a droppered \ 

i 

brown glass bottle labelled with a number and placed in sequence on the | 

table before S. S also had a wooden rack and a supply of test tubes in \ 

- I 

which to do his mixing. Because hair- and eye-color are so frequently \ 

\ 

used as examples in elementary science discussions of heredity we decided | 
not to use combinations of these two properties for the CO task, as had I 

Inhelder and Piaget. Rather, we used health or disease (the red-spot 1 

disease which was characterized by a sad expression) and presence or 
absence of disease agent (green germs on a microscope slide and red 
spots on face) . Drawings representing all possible combinations of 
these two binary variables were prepared on ditto stencil and pasted on I 

3 X 4 in. pieces of cardboard. 

Procedure . Each S^was run In two sessions separated by several days to a j 



Insert Table 1 about here 



sheets. The materials for the CH task were the same as employed by 
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week. On the first session S was instructed in the procedure for the 

FS task and did four or five practice problems followed by the ei^ht 

problems of the experimental series. For each of these problems two time 

measures were recorded: time from start of problem to openinft of the 

* 

first shutter. Time I; and time to completion of the problem. Time II. 

At the end of the session S was asked to describe his procedure for 
solving the problems. 

For the FS task S was ^iven an answer sheet with eiijht nunobered 
patterns of eir;d>t binary elements (black or \diite circles) and a problem 
board in which one of the patterns was concealed by a movable shutter 
over each element. Ills task was to identify the concealed pattern by 
uncovering as few of its elements as possible. Elements differed with 
respect to their potential informational outcome: half of them (safe 

moves) would yield one bit of information (i.e. , eliminate half of the 
patterns which were potential solutions) whereas the other half would, 
at best, eliminete only one pattern from furtdier consideration. The most 
efficient strate;^/ for this task was, thus, to select three one-bit 
elements to uncover. Such a strate'iiy will be called an ” ideal strategy”. 

At the start of the second session E had two test tubes, each 

-m- ^ 

containing a colorless liquid (water in one and a combination of phosphoric 
acid and peroxide in the other) . She showed that by adding a drop of G 
(potassium iodide) to each test tube an amber-colored liquid was produced 
in only one of the test tubes. S was then told want -/ou to mal<e the 
yellow color for me; you mav use any of these droppers to do so?. He 
was told that he could use as many test-tubes as he needed anJ that he 
could also use the pad and pencil beside him to keep track of combinations 
if he so desired (very few Ss did so) . After S had performed this task 
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(or, in a few Inatancea, "iven up end refused to 'y> on) , he was given a 
shuffled deck of twelve cards and l:old: ”You are a doctor. You have been 
seeing a lot of ladies in '/our office; some of them are sick and some of 
them are well. You have taken a microscope slide for each one and some ^ 

of the slides have :;reen r:erms while others do not. I want */ou tt look 
throu^ these cards and decide whether or not r;reen '■’erms cause the spot 



disease**. Tlie deck contained 4 cards showing a healthy face and no germs, 
4 showing a sick face with germs, 2 witii a healthy face and germs, and 2 
with a sick face and no germs* After announcing his decision S was 
asked **do you mean green germs always (never) cause sickness or is this 
more like the weather report, vdiere the announcer says, for example, 
there is a 6096 chance of showers?”* The S was then asked to select from 
his deck those cards which would prove conclusively that green germs cause 
sickness* After doing so he was given the deck again and asked to select 
from it all the cards which would prove conclusively that green germs 
have nothing to do with sickness* 

Results 

Criteria for scoring * We initially planned to use the scoring system of 
Wynns (1967) for the CIl task but had to modify it slightly* Scoring was 
as follows: 0-, does not use G each time until reminded and then 

produces purely random conibinations; 0, purely random combinations of one, 
or more, chemicals with G; random con(hination8 (as above) hut with 
occasional evidence of primitive order (e*g*, G‘i'l‘i'2‘1'3‘1'4); 1, 
primarily random combinations hut with evidence of t<eeplng track of past 
trials 0>y taking notes or absence of duplications) ; 2 , systematic 
pairing of each single ingredient with G but no plan beyond this; 3, 
systematic pairing of each single ingrc^dient with G followed by systemstic 
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testing of pairs of ingredients; M>, procedure as in 3 but soins on to 
test for uniqueness of the co^ination* 

For the CD task three aspects of perforstance were rated: sorting 
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throu^i the data» and response to each of the *two subsequent questions* 

Scoring for sorting tlirou^ the deck initially was as follows: D, no 

systematic procedure so that S cannot even tell where he began (e*g* putting | 
the top card on the bottom and proceeding in this fashion) ; 0^^ no sorting 

i 

but looking at each only once; 1, sorting into two piles (either healthy 
vs* sick or germs vs* no germs, or some combination of these vs* all 

1 

others); 2, sorting into 4 piles in a row; 3, sorting into 4 piles arranged 

I 

in a 2 X 2 contingency array* The deck produced in answer to the reqi^st ^ 
^rppnove the cards which ”don*t fit** and to produce a deck which shows j 

germs and disease are related was scored as follows: D, for the j 

I 

4 cards illustrating sickness and germs combined; 1, for the four showing | 

sickness and germs plus the four showing health and no germs; 0-, for all | 

1 

else* Similarly, the deck produced in response to the request to j 

] 

assemble instances showing that germs and disease are unrelated was j 

i 

i 

scored: D, for either of the two discrepant instances (germs and health 

i 

or sickness and no germs); 1, for both of the discrepant pairs; 2, for a | 

I 

deck containing two instances of each of the four possible combinations. | 
Total score was the sum of the three ranl<s. J 

foip the PS task a number of quantitative scores were available. Four | 

1 

measures deal with S*s information-gathering strategy over tlie G esqperi- | 

” j 

mental problems: safe first moves refers to the number of initial slmtter | 

choices out of 3 on ^ich S obtained 1 bit of information (4 reflects | 

i 

chance; 0 is maximum and less than 4 reflects "gambling”) ; m* of ideal I 

■ i 

i 

refers to the number of problems solved by a series of three shutter j 
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openings eadi of viiiich yielded one bit of information; and no* ^ 0 moves 
refers to the imnnber of shutter openin;^ which yielded no information* The 
fourth measure is the sum of the strater.*y scores for each of the ei^t 
problems (a strategy score is obtained by summing the expected informational 
outcomes for each move and dividing by the number of moves) ; the maximum 
possible score is 0* In addition there were two time scores and a 
qualitative rotiitj, verbal level* of S^s description of his strate^* 

Verbal level was scored: 0» no plan or an irrelevant one; 1, at that 

point at tdiich two possible answers remained, comparins the two patterns 
and selectinc; that shutter with respect to which they differed; 2, a plan 
for the last move plus one subsequent one; 3, selecting on each move 
in such a way as to halve the alternative possible solutions* 

Insert Table 2 about here 

Resopnee measures and their interoorr elations * Table 2 summarizes group 
means and variances for girls and boys separately and for the total group, 
hb attempt was made to test for significance of sex differences since this 
experiment was not designed to provide sudi canqparison* Table 3 summarizes 
intercorrelations among measures for the entire gi^p: levels of signi* 

finance for correlations for each sex separately are indicated above the 
diagonal with boya at the upper right and girls at the lower left of each 
cell* Althouc^ the table is complicated Its Import Is simple* Correlations 
among PS measures of performance are highly intercorrelated — as one would 
expect*-and these relations hold for both boys and girls* Of tlie PS time 
measures Time I, or presolution thinking time. Is hlf^ly correlated with 
performance: Ss idio think first do better* The correlations for Time II, 

solution time, are more irregular but they tend to suggest that Ss who take 
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a Ions solvins (and who, presuniably, do their tbintcing in a contex^ 
of doins rather than prior to action) do more poorly; however, these 
relationa are also confounded with number of moves: Ss vdio make more 

moves take longer and do more poorly* The information of major interest 
is the correlation of the two Piaget tasks, OI and CO, with PS* In general 
there Is a low but consistent correlation of performance on CO and PS 
althou^ this seems to hold for boys to a greater extent than for girls* 

In the case of CII, it does not corra/^te with either PS or CO for either 
the boys or the girls* The only thing with which CH is correlated is IQ 
and Mft* Thus, it would appear either that there is no evidence for a 
structure of formal operations, or that the CH task Is a poor measure of 
formal operations thinicing* At present we incline to the latter view* 

Insert Table 3 about here 

Intercorrelations amom performance ai^ scholastic achievement tests * 
Itttercorrelations among measures of pm^formance and scores on the Stanford 
Achievement tests for td:e Ss of Ethel Hoad school are summarized in Table >(* 

Insert Table 4 about here 

In general, neitlier of the Piaget tastes is correlated with achievement 
whereas some of the PS measures tend to be so correlated (especially 
verbal level and, to a lesser extent, TLme I)* The achievement scores 
with which PS performance are most highly correlated are Arithmetic Concepts 
and Reading Comprehension* Interpretation of Table 4 Is complicated by 
the finding of a different pattern of correlations for the boys (NslS) 
than for the girls (Hs^lO) . For the girls Reading Coo^rehension correlates 
jfith a number of PS measures tdiereas for the boys Arithmetic Coo^ehension 
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does so. However t because of the small size of the two si^oups and 
because of the existence of a mrnber of lar^e differences between them 
with respect to performance, achievement, and individual difference 
measures, it is pointless to pursue comparisons. 

Discussion 

With respect to tlie original question of determining inter correlations 
among a naitber of presumed formal operations tasics, altliough the results 
do not argue for much of a high interrelation among tastes the conclusion 
that no such relation exists does not seem warranted. Fii^t, if one 
compares frequency distributions of ranleings on CO, CH,and PS verbal level 
(see Table 5) it is apparent that the three tasks differ in difficulty 
wil^ FS being easier than CO and Furthermore, since formal operations 

thinking at its most abstract level Is not completely attained until the 
late teens, one could ar£^e that the age range employed is much too 
restricted to provide an adequate test. Indeed there is internal evidence 
^hat the unselected ^ san^le, even for the younger ages. Is not particularly 
representative of the general population of grades 5, and 6. , Finally, 
one can legltLmately question the selection of specific tasics employed: 
the selection is extremely limited and perhaps these tasks are not the 
best representations of formal operations thinking. 

Insert Table 5 about here 

Piaget* s treatment of formal operations thought is couched in terms 
of an elegant system of 16 logical operations and the tasics employed by 
him and Inhelder are designed to measure specific ones of these operations. 
We have by no means adequately sampled from among the range of hypotliesized 
operations. Moreover, one would esqpect that some of the aspects of formal 
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opei^ations thought are developed sooner than others — as would be Lnqplied 
by the assumption of hierarchical organization with full developinent bein^ 
incon^lete until well on in the teens. Only more extensive work with a 
broader age range, a more carefully constituted sample of Ss, and a greater 
variety of tasl<s can answer these objections. 

Some impressionistic comments on the present assortment of tasl<s are 
perhaps in order, (fore recent work in which the same S does both the 
^^ination of colors task (Piaget and Inhelder, 1951; Goodnow, 1962) and 
the CH task (which is logically equivalent to it) have left us uneasy about 
the CH ti :-k. Children who do the combinations task perfectly well (and 
successful performance of this task appears to occur in pre- adolescence) do 
very poorly on the CH task. We have the impression that the properties of 
the CH task provide an is?resistable stimulus to manipulative play and that 
this incitement to a more primitive level of operation overcomes any 
analytic problem-solving set tdiich a child mi^t normally bring to the 
experimental situation. They just have a ball mucking around with test 
tubes and liquids. Thus, the CH task mi^t not be especially appropriate 
for use with American children. 

It will be noted that the PS task bears no obvious relation to the 
Inhelder and Piaget tasks. We have used it extensively first because it 
provides a more objectively administered and scored procedure, and second 
because it is a more appropriate paradigm of the author's personal app3^ach 
to formal operations thought. 1 have assumed that with increasing age 
and its acconqianying broadening of experience with situations in vdiich 
orderly relationships are observed, the child begins to adopt a ^'set" to 
seeking order and to understanding new situations in terms of principles 
based upon previousl^experienced situations. To this end he develops 
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general heuristics, or strategies, for collecting and storing information- 
i«e«, a systematic approach to tasks vAiich transcends the particular 
stimulus characteristics of a given task* Such an approach is partially 
reflected in the amount of time spent in surveying the task prior to overt 
action* It is assumed to be more specifically reflected in e*g*, the 
infomnation-gathering behavior on the PS task, sorting of instances on the 
CO task, and devising of systematic orderings on the CH and combination 
of colors tasks* The existence of consistent positive (albeit low) 
correlations among the PS, CO, and more recently, conibination of colors, 
tasks is con^atible with this position* The fact that results for the 
CH task are inconsistent with the view is not seen to be terribly des- 
tructive in view of special properties specific to that task* 
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Footnote 

1 . 

This x^search was supported under grant HD 1725-02 f^m the Child 
Health and Human Development division of U. S. Public Health 
Service. We a 3 ^ grateful to Bernard Koziel and ton Ranhin, 
principals of the Roosevelt and Ethel Road Schools, for their 
cooperation in mahing space and subjects available. The data 
were gathered by Han Lewis; they were analyzed by Beatrice 
Rogomentich. Gratitude is expressed to Dr. David Rosenhan for his 
help in obtaining computer analyses of the data. 

2 . 

Although CO might appear to be con^arahle to CH, since scores here 
represent a sum of three rankings the maximum score is 6. Thus, it 
is obvious that nc children in the study have fully attained the 
concept of correlation. 
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Table I 

Age and Intelligence characteristics of the subject saniple 



Measure 


Boys 


Girls 


Total 


N 


31 


30 


61 


C.A. in months. It 


138.87 


141.57 


140.20 


C.A. in months, 


10.66 


lO.OS 


10.45 


M.A. in months, X 


m.S2 


160.03 


157.23 


H.A* in months, ar 


19.69 


17.38 


18.79 


I,Q, (Otis),'X 


m.6i 


U2.67 


112.13 


I.Q. (Otis), <r 


10.57 


9.76 


10.19 



A 

t 

\ 

\ 

j 

1: 

r 
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Table 2 

Summary of mean and standard deviation (in parenthesis) for 

several response measures 



Measure 



Boys 



Girls 



Total 



PS. 


Strategy 


6.71 


(1-07) 


6.59 


(1.29) 


6*65 


(1-18) 


PS. 


0 moves 


5*03 


(6.96) 


6.10 


(7*83) 


5.56 


(7*42) 


PS. 


Safe first 


5*16 


(1-67) 


5.53 


(1-54) 


5*34 


(1*62) 


PS. 


Ideal 


2.97 


(1*89) 


3.30 


(2.48) 


3*13 


(2*21) 


PS. 


Time 1 


98.52 


(60.48) 


75.00 


(50.97) 


86.95 


(57.22) 


PS. 


Time n 


801.77 


(141.29) 


752.83 


(268*94) 


777.70 


(215.21) 


PS. 


Verbal level 


1.90 


(1*00) 


1.65 


(1.14) 


1.78 


(1.08) 


CO 




1.61 


(0.75) 


1.80 


(1.08) 


1.70 


(0.93) 


CH 




1.28 


(1*22) 


1.07 


(1-21) 


1.17 


(1*22) 
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I'teiirasfc Table 3 

Intercorrelations amon^ response p.easures O^lovr diagonal) i^ith lei/els of sigi 

above the diagov 



Measure 


1 


2 


3 


4 


5 


6 


t 


1, PS, Strategy 


X 


kitk 

itkk 


.kk 

ifr* 


A# 

** 


A# 

kk 


A 

/ 


ki 


2, FS, 0 moves 


** 

-.98 


X 


* 

** 


kk 

kk 


kk 

KA 


* 


AH 


3. FS, Safe first 


•kit 

.62 


«* 

-.52 




kk 

kk 


AA 

A 


/ 




4. FS, Ideal 


** 

.86 


*• 

-JB 


** 

.77 




A 

AA 


- / 


** 


5. FS, Tlire I 


** 

.50 


kk 

-.47 


kk 

.45 


vtw 

.42 


X 




i 

J 


6, PS, Tiire 11 


a 

-.30 


♦ 

+.27 


-.20 


** 

-.33 


A 

.29 






7, PS, Verbal level 


*k 

.87 


** 

-.84 


** 

.57 


kk 

.75 


AA 

.60 


-.18 




Q. CO 


•k 

.28 


* 

-.26 


* 

.25 


/ 

.24 


/ 

.22 


.06 


• 1 


9. CH 


.08 


-.06 


.02 


.03 


.02 


-.04 


■ 

: 


10. C.A. 


.10 


-.12 


.01 


.08 


.11 


A 

-a31 


* 


ii. M,A, 


.22 


-.19 


.16 


.22 


/ 

.24 


A 

-.28 


• . 


IS. I.Q. 


.22 


-.19 


.19 


/ 

.24 


A 

.25 


-.15 





/ ^ Significance at ,10 level 
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Significance at ,05 level 
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Table 3 
Tfrels of 1 
'e the die 
6 


signlficai 

igooal. 

7 1 


ice for bi 
8 


oys (uppei 
9 


p right) 
10 


and girls 

1 


1 

(lower 1( 
12 


IS 

sft) ! 


It* 

a 


*« 

*« 


* 

/ 


♦*' 

** 


* 










4 

: 

■ 

1 


** 

r 


** 


* 


** 


/ 










L ** 


** 

* 


/ 


*4t 

** 


* 








* 


k 


** 


/ 


** 

** 


* 
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Table 4 

Intercorrelations among subject and performance variables and Stanford 

Achievement Test Scores 

Reading Arithmetic Arithmetic 





Vocabulary 


Con^rehension 


Comprehension 


Concepts 


PS, Strategy 


.29 

4 


* 

.44 


. 34 '^ 


ft 

.38 


PS, 0 moves 


-.26 


* 

-.42 


-.30^ 


ft 

-.36 


PS, 1st move 


.27 


.20 


.27 


.20 


PS, Ideal 


.22 


. 3 / 


.39* 


.25 


PS, Time I 


.33^ 


ft 

.37 


.33*^ 


ftft 

.47 


PS, Time 11 


.14 


.03 


-.10 


.01 


PS, Verbal level 


a 

.36 


ftft 

.51 


ft 

.40 


ftft 

.50 


CO 


.21 


.15 


.U 


.13 


CH 


,20 


.27 


,07 


.26 


CA 


.15 


.09 


.03 


.05 


MA 


-* — *- 

Ww 

.65 


ftft 

.64 


« * 
.38 


ftft 

.62 


IQ 


7^.* 


.74** 


ft 

.43 


ftft 

.68 


3c 


7.87 


8.07 


6,97 


7.44 


(T 


1.61 


1.95 


1.51 


1.84 
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Table 5 

Frequency distributions of scores on CH» CO, and FS verbal level 

Rank 



Task 


0 


1 


2 


3 or 


FS 


13 


6 


27 


IS 


CO 


3 


26 


21 


11 


CH 


28 
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12 


13 
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